Variational Bayesian Dirichlet-Multinomial Allocation for Exponential Family Mixtures
نویسندگان
چکیده
We study a Bayesian framework for density modeling with mixture of exponential family distributions. Our contributions: •A variational Bayesian solution for finite mixture models • Show that finite mixture models (with a Bayesian setting) can determine the mixture number automatically • Justify this result with connections to Dirichlet Process mixture models •A fast variational Bayesian solution for Dirichlet Process mixture models
منابع مشابه
Variational inference for Dirichlet process mixtures
Dirichlet process (DP) mixture models are the cornerstone of nonparametric Bayesian statistics, and the development of Monte-Carlo Markov chain (MCMC) sampling methods for DP mixtures has enabled the application of nonparametric Bayesian methods to a variety of practical data analysis problems. However, MCMC sampling can be prohibitively slow, and it is important to explore alternatives. One cl...
متن کاملDynamic Hierarchical Dirichlet Process for Modeling Topics in Time-Stamped Documents
We consider the problem of inferring and modeling topics in a sequence of documents with known publication dates. A novel topic model is introduced, based on an extension of the hierarchical Dirichlet process (HDP), termed the dynamic HDP. The details of this general framework may take different forms, depending on the specifics of the model. For the examples considered here we examine base mea...
متن کاملVon Mises-Fisher Clustering Models
This paper proposes a suite of models for clustering high-dimensional data on a unit sphere based on von Mises-Fisher (vMF) distribution and for discovering more intuitive clusters than existing approaches. The proposed models include a) A Bayesian formulation of vMF mixture that enables information sharing among clusters, b) a Hierarchical vMF mixture that provides multiscale shrinkage and tre...
متن کاملVariational Bayes In Private Settings (VIPS)
Bayesian methods are frequently used for analysing privacy-sensitive datasets, including medical records, emails, and educational data, and there is a growing need for practical Bayesian inference algorithms that protect the privacy of individuals’ data. To this end, we provide a general framework for privacy-preserving variational Bayes (VB) for a large class of probabilistic models, called th...
متن کاملThe Population Posterior and Bayesian Modeling on Streams
Many modern data analysis problems involve inferences from streaming data. However, streaming data is not easily amenable to the standard probabilistic modeling approaches, which require conditioning on finite data. We develop population variational Bayes, a new approach for using Bayesian modeling to analyze streams of data. It approximates a new type of distribution, the population posterior,...
متن کامل